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ABSTRACT 

Let  B  be  a  real  separable  Banach  space  and  R:  B*  4  B  a  covariance  operator. 
All  representations  of  R  in  the  form  Te  ®e  ,  {e  ,  n>l}  c  B,  are  characterized. 
Necessary  and  sufficient  conditions  for  R  to  be  compact  are  obtained,  including 
a  generalization  of  Mercer' s  theorem.  An  application  to  characteristic 
functions  is  given. 
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1.  \lntroduction 


Mr* - 

The  study  of  covariance  operators  is  a  major  component  in  the  theory  of 
probability  measures  on  Banach  spaces  [1*H,  [?],  [1<P-  The  covariance  oper¬ 
ator  of  a  strong  second-order  measure  is  always  compact  [2% ;  however,  the 
covariance  operator  of  a  weak  second-order  measure  need  not  be  compact.  In 
this  paper  we  first  characterize  series  representations  of  covariance  oper¬ 
ators,  and  then  give  a  set  of  necessary  and  sufficient  conditions  for  a 
covariance  operator  to  be  compact.  The  classical  Mercer's  theorem 4*}  can  be 
obtained  as  an  immediate  corollary.  These  results  are  then  applied  to  extend 
a  result  of  Prohorov  and  Sazanov  on  relative  compactness  of  probability 
measures  from  Hilbert  space  to  Banach  space. 

2.  Definitions  and  Notation 

B  is  a  real  separable  Banach  space  with  norm  |  ( •  ( |  and  topological 

dual  B*.  A  linear  operator  R:  B*  B  is  a  covariance  operator  if  R  is 

symmetric  and  non-negative:  <Ru,v>  =  <u,Rv>  and  <Ru,u>  >  0,  for  all  u,v  in 

B*.  A  probability  measure  y  on  the  Borel  o- field  of  B  is  said  to  be  weak 

2 

second-order  if  / B<x,u>  dy(x]  <  °°,  for  all  u  in  B*;  y  is  strong  second- 
2 

order  if  /g| |x| |  dy (x)  <  «.  Every  weak  second  order  measure  y  has  a 

mean  element  m  in  B  and  a  covariance  operator  R:  B* -*■  B  [9  ],  [10],  defined  by 

<m,v>  =  /B<x,v>dy(x) 

<Ru,v>  =  /B<x-m,u><x-m,v>dy(x)  , 

for  all  u,v  in  B*.  Strong  second-order  measures  have  compact  covariances; 
the  strong  second  order  property  is  not  necessary  in  order  that  y  have 
compact  covariance. 

For  a  covariance  operator  R:  B*  B  it  is  well  known  [8],  [1],  that  there 
exists  a  separable  Hilbert  space  H  c  B  such  that  the  natural  injection 
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j :  H  -*•  B  is  continuous  and  R  =  jj*.  H  is  the  RKHS  of  R  and  is  the  comple¬ 
tion  of  range  (R)  with  respect  to  the  inner  product  <*,*>^  defined  by 
<Ru,Rv>H  =  <Ru,v>. 

Ipj  will  denote  the  identity  on  H.  For  u,v  in  B*,  z  in  B  (resp.  in  H), 

(u®v)(z)  =  <v,z>u  (resp.,  <v,z>Hu).  If  T  is  any  map  r(T)  =  range(T). 

is  the  linear  topology  on  B*  determined  by  a  neighborhood  base  at  zero  of 

the  form  V„  (0)  =  {feB* :  sup<f,x>  <  e}  for  all  e  >  0  and  all  compact  sets 
L’£  X£C 

C  c  B  (tc  is  the  topology  of  uniform  convergence  on  compact  sets) .  For  a 
given  covariance  operator  R:  B*  -*■  B,  qR  is  the  real-valued  quadratic  func¬ 
tional  on  B*  defined  by  qRf  =  <Rf,f>.  The  notation  R  =  Inen®en  for 
{en,n>l}  c  B  means  that  the  sequence  (Iien®en)  converges  to  R  in  the  strong 

operator  topology:  Ii<en»f>en  -*■  Rf  in  the  norm  topology  of  B,  for  all  f 
in  B*.  IH  =  Inen®en  has  a  similar  interpretation.  If  {un,n>l}  is  any 
orthonormal  basis  for  H,  then  R  =  ^ju^sju^,  [9  ].  KR  will  denote  the  unit 
ball  in  H. 

If  v  is  a  probability  measure  on  the  Borel  o-field  of  B,  its  character - 
stic  functional  p  is  defined  as 

u(x)  =  /  e^<x,y>dy(y)  ,  for  x  in  B*  . 
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3.  Representation  of  Covariance  Operators. 

In  this  section,  R  is  an  arbitrary  covariance  operator. 

Theorem  1.  R  =  Inen®en  if  and  only  if  en  *  jvn,  vneH  for  n  2  1,  and 
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Proof.  It  suffices  to  show  that  the  stated  conditions  are  necessary  for 
R  =  Inen®en-  Suppose  R  =  Inen®en »  and  fix  e^.  Let  Pk  =  ek®ek-  To  show 
e^  c  range(j),  let  (as  in  [3])  D:  r(j*)  -*■  B  be  defined  by  Dj*f  =  P^f.  Then 
!|Dj*f||2  =  l|Pkf||2  «  l!ek!!2<ek,f>2  s  l|ekl|2In<f,en>2  =  |  |ek|  |2<Rf,f>  = 
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1^11  I  !l*f  I  Ipp  Thus  D  can  be  extended  to  a  continuous  linear  map  from  r(j*)  = 

H  into  B.  From  its  definition,  Dj*  =  Pk,  so  Pk  -  jD*  and  thus  ek  £  range(j). 

_  _N 

To  see  that  IH  =  z.vn®vn»  where  jvn  =  en,  n  s  1,  define  Q^.  =  Z.ivn®vn* 

(^  =  Q*  and  QN  s  0,  so  exists.  |  |Qjj*f  1 =  lj<f>en>2  +  I  I  j*£l  »  so 

that  |  |qj*|  |  <  1  and  |  |QjJx|  |H  -^  |  |x|  |H  for  all  x  in  r(j*) .  Thus, 

I  Il5[(vn%^*£  '  j*f ! Ih  =  1 10^3*^  -  3*f|  Ih 
*  - !  Ih  +  H^Hh  • 

which  converges  to  zero  as  N  ->  »  for  any  fixed  f  in  B*.  Thus,  Jvn«vn  ■  IH 
on  r(j*),  and  the  result  follows  by  r  (j*)  *  H.  □ 

Remark.  Suppose  E  is  a  locally  convex  topological  vector  space,  R:  E'  -*•  E 
is  a  covariance  operator,  and  R  =  jj*,  where  j:  H  -*■  E  is  the  injection  and  H 
is  the  RKHS  of  R.  R  will  have  such  a  representation,  for  example,  if  E 
is  separable  and  quasi -complete  [8].  In  this  case,  it  is  easily  show  that 
Theorem  1  holds  without  modification. 

The  representation  1^  =  Ivn®vn  does  not  require  that  {vn,  n>l}  be  a  CONS 
in  H;  however,  sufficient  conditions  for  {vn,  n>l)  to  be  a  CONS  in  H  can  be  given. 

Proposition  1.  Suppose  1^  =  Ivn«vn;  the  following  are  equivalent: 

(1)  i|vkllH-  1 

(2)  vk  t  sp(vn,  n/k} 

(3)  Vk  x  sp{vn,  n#>  . 


If  any  of  the  above  conditions  hold  for  all  k  a  1,  then  {vn,  nsl)  is  a 
CONS  for  H. 
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4.  Compact  Covariance  Operators. 

Theorem  2.  Suppose  R  =  £en®en,  {en,nsl}  c  B.  Let  {vn,n>l}  c  H  be  such  that 
en  =  jvn>  n>l.  The  following  are  equivalent: 

(1)  R  is  compact; 

(2)  j  is  compact; 

(3)  j [Kr]  is  compact  in  B; 

(4)  the  series  Ivn®jvn  converges  uniformly  in  H  on  bounded  subsets  of 
B*; 

(5)  dien®en)  converges  to  R  uniformly  in  B  on  bounded  subsets  of  B*; 

(6)  qR  is  w*- continuous  on  bounded  subsets  of  B*; 

(7)  qR  is  T^- continuous. 

Proof.  (1)  =>  (2).  Suppose  f  f  in  the  w*  topology  of  B*,  where 

llfjl  s  k  for  all  a.  Then  |  |  j*fa-j*f  I  |„  -  <R(fa-f) , (fQ-f)>  *  2k|  |R(fa«f)  |  |fi; 

since  R  is  compact,  j*fQ  -*■  j*f  in  H  [4,  p.  486]  and  thus  j  is  compact. 

(2)  =>  (3).  j  compact  implies  j [Kj^]  is  relatively  contact  in  B.  Since 
KR  is  weakly  compact  in  H  and  j  is  weakly  continuous,  j  [KR]  is  weakly  conpact 
in  B,  and  thus  closed. 

(3)  =>  (2)  by  definition. 

(2)  =>  (4).  By  Theorem  1,  Invn«vn  =  IH.  Set  (^  -  IiVV  If  A  c  B*  is 
bounded,  then  j*[Aj  is  compact;  by  Dini's  theorem  | |0jx| |H  +  | |x| |H  uniformly  on 
j*  [A]  •  Hence  1 1  (C^-I)j*3t|  s  j  |j*x|  |jjj  -  |  |C^j*x|  -*•  0  uniformly  on  A. 

(4)  —>  (5),  since  j  is  continuous. 

(5)  ->  (1),  since  R  is  the  uniform  limit  of  conpact  operators. 

(2]  <“>(6) .  Follows  from  the  fact  that  j  is  conpact  if  and  only  if  j*f  -*•  0 
in  the  norm  topology  of  H  for  all  bounded  generalized  sequences  (fQ)  in  B* 
which  are  w*  convergent  to  zero  [4,  p.  486],  and  *  I  In* 
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(1)  =>  (7).  Suppose  R  is  compact.  Writing  C  =  j[KR],  C  is  compact  in  B. 

2  2  2 

qR(f)  =  <Rf,£>  =  | | j*f | lH  =  sup<j*f,x>^  =  sup<f,x>  .  Thus  qR  is  ^-continuous 
at  zero,  ^-continuity  of  qR  follows  from  qR(fa)  =  qR(fa-f)  -  qR(f)  +  2<Rf,fa>. 

(7)  =>  (1).  Suppose  qR  is  tc* continuous.  Using  (6),  R  is  compact  if  qR 
is  w*  continuous  at  0  on  bounded  subsets  of  B*.  But  B  is  separable  so 
that  the  w*  topology  on  bounded  subsets  of  B*  is  metrizable  and  it  suffices 
to  consider  sequences.  Suppose  fR  _►  0  and  | | f  n | |  <_  k.  Let  L  be  an  arbitrary 
compact  subset  of  B.  Since  {fn}  is  bounded  in  B*  the  f  are  equicontinuous 
and  uniformly  bounded  as  continuous  functions  on  L.  Thus,  by  the  Arzela- 

TO 

Ascoli  Theorem  [4,  p.  266]  {fn>  is  relatively  compact  as  a  subset  of  C  (L) . 

W*  Tp 

Thus  since  f n  ->■  0,  fn  converges  to  0  uniformly  on  L.  Therefore  f  -►  0 
and  qR(f  )  ->  0.  This  completes  the  proof  of  Theorem  2.  □ 

Remarks .  (1]  Suppose  r:  [0,1]* [0,1]  -*■  IR  is  continuous,  symmetric  and  positive 

definite.  For  fixed  te[0,l],  let  ^(x)  =  x^  for  x  in  C[0,1];  [  | |  |  =  1. 

A  compact  covariance  operator  R:  C*[0,1]  -*■  C[0,1]  is  defined  by  [Ry]  (t)  = 

1 

^  r(t,s)dy(s)  for  any  y  in  C*[0,1]  (by  Arzela-Ascoli  Theorem).  Thus  for 
s,te  [0,1] ,  <RiTt,iTs>  =  r(t,s).  Hie  integral  operator  in  L2[0,1],  corres¬ 
ponding  to  the  kernel  r,  has  continuous  orthonormal  eigenvectors  {yn,n2l} 
and  associated  non- zero  eigenvalues  Un,n>l};  it  is  well  known  that 
(A^yn,nsl)  is  a  CONS  in  the  RKHS  H  of  R.  Thus,  from  Theorem  2,  In-l\^n^^n^s) 
converges  uniformly  to  r(t,s)  for  all  t,s  in  [0,1].  This  is  the  classical 
Mercer's  Theorem  [7,  pp.  245-246]. 

(2)  The  fact  that  the  unit  ball  of  H  is  compact  in  B  when  R  is  compact 
was  proved  by  Kuelbs  [5  ]  under  the  assumption  that  R  is  the  covariance  of  a 
strong  second-order  measure. 
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5.  Characteristic  Functionals 

Let  A  denote  a  family  of  probability  measures  on  B  (separable  Banach)  and 

A 

A  the  corresponding  family  of  characteristic  functionals. 


Theorem  5.  Let  B  be  a  separable  Banach  space.  Then  the  following  are 
equivalent : 

a)  There  exists  a  topology  t  on  B*  such  that  for  each  family  A  of 

A 

probability  measures  on  B,  A  is  equicont inuous  in  this  topology  if  and  only 
if  A  is  relatively  compact  in  the  topology  of  weak  convergence 

b)  B  is  finite  dimensional. 

Proof.  As  in  the  Hilbert  space  case  (see  [  6,  Lemma  2])  tc  is  the  weakest 

topology  on  B*  such  that  relative  compactness  of  A  «>  equicont inuity  of  A. 

Suppose  that  (a)  holds.  Then  «  r  and  xc  equicont inuity  of  A  implies 

relative  compactness  of  A.  Now  let  R:  B*  -♦  B  be  any  compact  covariance  operator. 

Let  (c  1  be  a  CONS  in  the  RKHS  of  R,  Define  p.  to  be  the  zero  mean  Gaussian 
n  K 

k  a 

measure  on  B  with  covariance  operator  [^e^  «  e^.  Then  (pj.)  is  tc  equicont inuous 
by  Theorem  2  and  {p^.}  is  relatively  compact.  Therefore  R  is  the  covariance  of 
a  Gaussian  probability  measure  on  B  and  by  [9  ,  Theorem  11]  B  is  finite 
dimensional.  0 

Theorem  3  extends  a  result  of  Prohorov  and  Sazonov  [  6]  who  proved  it  for 


Hilbert  spaces. 
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